Seeing With My Ears

Seeing with Your Ears: A Wondrous Journey Across the Senses

We will briefly describe here a few studies that challenge this theory. Using a special method, named “sensory substitution,” researchers have been able to demonstrate that blind people could “see” using sounds. Using a brain scanner, they showed that those brain areas, thought to have lost their ability to process visual information, play a central role in the ability to “see using sound” and ...

Seeing Emotion with Your Ears: Emotional Prosody Implicitly Guides Visual Attention to Faces

Interpersonal communication involves the processing of multimodal emotional cues, particularly facial expressions (visual modality) and emotional speech prosody (auditory modality) which can interact during information processing. Here, we investigated whether the implicit processing of emotional prosody systematically influences gaze behavior to facial expressions of emotion. We analyzed the e...

With my own ears: the ethics of sound in non-fiction film and TV

Sound in non-fiction is routinely manipulated in order to accentuate, suppress or replace some aspects of sound to present a clearer, more intelligible, exciting, involving or dramatic representation to the audience. This manipulation, or potential for manipulation, indicates the need for a discussion on the ethical dimensions of such a practice. Ethical models across a range of disciplines suc...

Listening with Two Ears

Seeing Beyond Seeing with Enhanced Deep Tracking

Deep Tracking ([1]) is a recently proposed theoretical framework for end-to-end unsupervised visual tracking. Researchers have successfully applied the framework to directly predict full unoccluded space occupancy grid map from raw laser input data. Compared to traditional visual tracking methods on robotics and autonomous driving, which heavily relies on real world knowledge, the learning fram...